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Abstract. Statistical properties of environments experienced by biological signaling 
systems in the real world change, which necessitates adaptive responses to achieve 
high fidelity information transmission. One form of such adaptive response is gain 
control. Here we argue that a certain simple mechanism of gain control, understood 
well in the context of systems neuroscience, also works for molecular signaling. The 
mechanism allows to transmit more than one bit (on or off) of information about the 
signal independently of the signal variance. It does not require additional molecular 
circuitry beyond that already present in many molecular systems, and, in particular, it 
does not depend on existence of feedback loops. The mechanism provides a potential 
explanation for abundance of ultrasensitive response curves in biological regulatory 
networks. 



PACS numbers: 87.18.Mp, 87.19.lo 
Keywords: adaptation, information transmission, biochemical networks 



Gain control in molecular signaling 



2 



1. Introduction 

An important function of all biological systems is responding to signals from the 
surrounding environment. These signals (hereafter assumed to be scalars), are 
often probabilistic, described by some probability distribution P[s(t)]. They have non- 
trivial temporal dynamics, so that the probability of a certain value of the signal at a 
given time is dependent on its entire history. 

Often the response r{t) is produced from s by (possibly nonlinear and noisy) 
temporal filtering. For example, in a deterministic molecular circuit, we may have 

(IT 

^^=f{s{t))-kr, (1) 

where / is the response molecule synthesis rate, which depends on the current value of 
the signal. Here k is the rate of the first-order degradation of the molecule. Note that 
r{t) depends on the entire history of s{t'), t' < t, and hence carries information about 
it. For more complicated, nonlinear degradation or for r-dependent synthesis, Eq. ([1]) 
may be interpreted as linearization around the mean response. 

The distribution of stimuli, P[s{t)], places severe constraints on admissible forms 
of /. To see this, for quasi- stationary signals (that is, when the signal correlation time 
T is large, t ^ 1/k), we use Eq. ([1]) to write the steady state dose- response curve 

Tss = f{s{t))/k. (2) 

A typical monotonic, sigmoidal / is characterized by only a few large-scale parameters: 
the range, [/mm, /max]; the mid-point Si/2; and the width of the transition region. As 
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Figure 1. Parameters characterizing response to a signal. Left panel: the probability 
distribution of the signal, P{s) (blue), and the best-matched steady state dose-response 
curve Tss (green). Top right: if the mid-point of the dose- response curve, Si/2, is far 
away from the mean of the signal, a typical response will be extremal. Bottom right: 
if the width of the dose-response curve. As, is considerably different from the standard 
deviation of the signal, then the typical response is either extremal, or at its mid-point. 
These mismatches prevent using the entire dynamic range of the response to convey 
information about the signal. 
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(cf. Fig. H]). If the signal mean /i ^ Si/2, then, for most signals, ~ fmax/k. Then 
responses to two different signals Si and S2 are indistinguishable as long as 



where 6r is the precision of the response resolution. Similarly, when jj, <^ si/2, then 
'"ss ~ /min/fc- Thus, for reliably communicating information about the signal, / should 



in /i, this is called adapting to the mean of the signal, and, if Si/2(/i) = fi, then the 
adaptation is perfect pQ |2]. Similarly, if the quasi-stationary signal is taken from the 
distribution with a = — yU^)^^^ ^ As, then the response to most of the signals 

will be indistinguishable from the extrema. It will be near ~ (^'max + ^min)/2 if cr ^ As. 
Thus, to use the full dynamic range of the response, a biological system must tune 
the width of the sigmoidal dose-response curve to As ~ a; this is called the variance 
adaptation or gain control [2] . 

Both of these adaptation behaviors can be traced to the same theoretical argument 
[3]: for sufficiently general conditions on the response resolution 6r, the response that 
optimizes the fidelity of a signaling system, as measured by its information-theoretic 
channel capacity [1], is r*^{s) = P{s')ds', where -P(s') is the probability distribution 
of an instantaneous signal value, obtained from P[s(t)]. However, since environmental 
changes that lead to varying /i and a, as well as mechanisms of the adaptation may be 
distinct, it often makes sense to consider the two adaptations as separate phenomena 



Adaptation to the mean, sometimes also called desensitization, has been observed 
and studied in a wide variety of biological sensory systems IH El [3l [6l [7] , with active work 
persisting to date. In contrast, while gain control has been investigated in neurobiology 
[8l|9l[T0], we are not aware of its systematic analysis in molecular sensing. In this article, 
we start filling in the gap. Our main contribution is the observation that a mechanism 
for gain control, observed in a fiy motion estimation system by Borst et al. [TO] , 
can be transferred to molecular information processing with minimal modifications. 
Importantly, unlike adaptation to the mean, which is implemented typically using 
extra feedback circuitry [H [TJ [11], the gain control mechanism we analyse requires 
no additional regulation. It is built-in into many molecular signaling systems. The 
main ingredients of the gain control mechanism in Ref. is a strongly nonlinear, 
sigmoidal response function /(s) and a realization that real- world signals are dynamic 
with a nontrivial temporal structure. Thus one must move away from the steady state 
response analysis and autocorrelations within the signals will allow the response to carry 
more information about the signal than seems possible naively. 

Specifically, we show that even a simple biochemical circuit in Eq. ([1]), with no 
extra regulatory features can be made insensitive to changes in a. That is, for an 
arbitrary choice of a, and for a wide range of other parameters, the circuit can generate 
an output that is informative of the input, and, in particular, carries more than a single 
bit of information about it. For brevity, we will not review the original work on gain 




(3) 



be tuned such that Si/2 ~ /i. If a biological system can change its Si/2 to follow changes 
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control in neural systems [TD], but will instead develop the methodology directly in the 
molecular context. 

2. Results: Gain control with no additional regulatory structures 

Let's assume for simplicity that the signal in Eq. ([T]) has the Ornstein-Uhlenbeck 
dynamics with: 

{s{t))=fi, {s{t + t')s{t)) = a'e-''/\ (4) 

We will assume that the response has been adapted to the mean value of this signal 
(likely by additional feedback control circuitry, not considered here explicitly), so that 
the response to s = is half maximal. Now we explore how insensitivity to a can be 
achieved as well. 

We start with a step-function approximation to the sigmoidal response synthesis 

{0, s < /i, 
1/2, s = /i', (5) 
1, s > /i, 

where /o is some constant. This is a limiting case of very high Hill number dose-response 
curves, which have been observed in nature p2]- Figure [2] shows sample signals and 
responses produced by this system. Notice that such / makes the system manifestly 
insensitive to a. Any changes in a will not result in changes to the response, hence the 
gain is controlled perfectly. 
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Figure 2. Examples of signals and responses for dynamics in Eqs. ([T]|4l[5]). On the 
vertical axis, we plot normalized signals = (s — m)/max(s) (green) and normalized 
responses r = r/max(r) (blue). On the horizontal axis, the time is rescaled by the 
correlation time of the signal, t. Panels (a)-(c) have fcr = 0.1, 1, 10, respectively [recall 
that l/Zc is the response time of the circuit, Eq. ([T])]. In panel (d), we show, for 
comparison, the firing rate of a blow fly motion sensitive neuron HI and its driving 
stimulus, both rescaled to one (see [13] for details of this experiment). The stimulus 
had little power at high frequencies, but the single-exponential correlation structure 
held for long times. Notice the similarity between the telegraph-series-like structure 
of the responses in panels (c) and (d). Since the HI neuron served as a model neural 
system for the feedback- free gain adaptation in [10] , this similarity suggests to look for 
gain-controlled responses in molecular signaling, Eq. ((U, as well. 



Gain control in molecular signaling 



5 



Nevertheless, this choice of / is pathological, resulting in a binary steady state 
response {vss = for s < yU, and = fo/k otherwise). That is, the response cannot 
carry more than one bit of information about the stimulus. However, as illustrated in 
Fig. [2], a dynamic response is not binary and varies over its entire dynamic range. Can 
this make a difference and produce a dose-response relation that is both high fidelity 
and insensitive to the variance of the signal? 

To answer this, we first specify what we mean by the dose-response curve or the 
input-output relation when there is no steady state response. For the response at a 
single time point t, we can write P (r (t) |{s (t' < t)}) = 6{r — r[s]), where S{- ■ ■) is the 
Dirac 5-function, and the functional r[s] is obtained by solving Eq. ([T]). Since the signal 
is probabilistic, marginalizing over all but the instantaneous value of it at time t — t', 
one gets P (r (t) \s {t — t')), the distribution of the response at time t conditional on the 
value of the signal at t — t'. Further, for the distribution of the signal given by Eq. (jl]), 
one can numerically integrate Eq. ([1]) and evaluate the correlation c(t') = {r{t)s{t — t'))t 
0. Since Eq. ([T]) is causal, c{t') has a maximum at some t' = A(r, k) > 0, illustrated in 
Fig. 131 Correspondingly, in this paper we replace the familiar notion of the dose-response 
curve by the probabilistic input-output relation P{r{t)\s{t — A)). 

In Fig. m we plot the input-output relation for kr = 10. To emphasize the 
independence of the response on a and hence the gain-compensating nature of the 
system, we plot s in units of a. A smooth, probabilistic, sigmoidal response with a width 
of the transition region A ~ cr is clearly visible. This is because, for a step-function 
/, the value of r(t) depends not on s(t), but on how long the signal has been positive 
prior to the current time. In its turn, this duration is correlated with s/a, producing 
a probabilistic dependence between r and s/a. The latter is manifestly invariant to 
variance changes. 

X All simulations were performed using Matlab v. 7.6 and Octave v. 3.0.2 using Apple Macbook Air. 
Correlation time of the signal was r = 300 integration time steps, and averages were taken over 3 x 10^ 
time steps. To change the value of fcr, only k was adjusted. 
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Figure 3. Dependence of the delay between the signal and the response, A, which 
achieves the maximum correlation between s and r. Here A is expressed in units of the 
signal correlation time r, and it is studied as a function of fcr, the ratio of characteristic 
time scales of the signal and the response dynamics. 



Gain control in molecular signaling 



6 



These arguments make it clear that the fidehty of the response curve should depend 
on the ratio of characteristic times of the signal and the response, kr. Indeed, as seen 
in Fig. [21 for A;r — )■ 0, the response integrates the signal over long times. It is little 
affected by the current value of the signal and does not span the full available dynamic 
range. At the other extreme of a very fast response, kr — oo, the system is almost 
quasi-stationary. Then the step-nature of / is evident, and the response quickly swings 
between two limiting values {fo/k and 0). 

We illustrate the dependence of the response conditional distribution on the 
integration time in Fig. [5] by plotting f(A, s) = / drr(t + A)P{r(t + A)|s(t)), the 
conditional-averaged response for different values of kr. Neither kr nor kr ^ oo 
are optimal for signal transmission. One expects existence of an optimal k*, for which 
most of the dynamic range of r gets used, but the response is not completely binary. 
To find this optimum, we evaluate the mutual information |1] between the signal and 
the response at the optimal delay, Ik[r(t + A),s()f:)], as a function of kr, cf. Fig. [61 A 
broad maximum in information transmission is observed near k* ~ 20/r, which is not 
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Figure 4. Conditional distribution P{r{t)\s{t — A)) for fcr = 10. The signals are 
discretized into 30 values in the range of [— 3cr, +3cr]. For each s(t — A), a histogram 
of r{t) is built with 100 distinct r values. The normalized histograms are grey-scale 
coded as columns on the plot, with dark representing the higher conditional probability, 
P 1. We use a nonlinear color scale to enhance the plot. 




Figure 5. Mean conditional response r(A, s) for different combinations of the signal 
and the response characteristic times, kr. 
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too far from the quasi-stationary hmit. However, /max = ^k* = 1-37 bits is substantially 
larger than 1. Thus temporal correlations in the stimulus allow to transmit 37% more 
information about it than the step response would suggest naively. This information is 
transmitted in a gain-controlled manner, so that changes in a have no effect. Similar 
conclusion should hold for non-step-hke /, as long as / is sigmoidal and As /a <^ 1. 

Effects of the signal structure. The observed gain insensitivity depends only 
weakly on details of the temporal structure of the signal. As long as there are 
autocorrelations, one can use them to transmit more than one bit about the signal 
in a gain-independent fashion using the strong nonlinearity of /. To verify this, 
we replace the Ornstein-Uhlenbeck signal, Eq. (jl]), with its low-pass filtered version, 
s'{t) = 1/k dt' s{t')e~^^*~*'\ and k is the same as in Eq. ([1]). This new signal is 
smoother and has less structure at high frequencies. We repeat the same analysis as 
above to find A, estimate the conditional response distribution, and then evaluate 7^, 
the stimulus-response information. We find that the maximum information in this case 
is /max = 1-35 bits, statistically indistinguishable from the Ornstein-Uhlenbeck case. 
However, the maximum is now at A;r ^ 3. This is because the smooth signal has a lot 
fewer short-lived zero-crossings, and smaller integration times are needed to approach 
the extreme values of the response. 

Knowing a in a gain-insensitive response. When gain-insensitive, the system looses 
information about the actual signal variance. This rarely happens in biology. For 
example, while we see well at different ambient light levels, we nonetheless know how 
bright it is outside. For the fly visual system, it was shown that variance independence of 
the response breaks on long time scales. The signal variance can be inferred from long- 
term features of the neural code [El [H]. Correspondingly, we ask if long term observation 
of the response of an approximately gain-controlled molecular signaling circuit allows 
to infer the signal variance a. 
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Figure 6. The signal-response mutual information at the optimal temporal delay as 
a function on fcr. The solid line represents /fe[r(t + A),s(t)], the information for the 
Ornstein-Uhlenbeck signal, and the maximum of the information here is /max = 1-37 
bits, achieved at k* « 20/r. The dashed line stands for the same information for the 
smoothed signal. It is maximized at fc* « 3/t with /max = 1-35 bits. 
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To this extent, consider / as a narrow sigmoid, with the width of the crossover 
region As /a ^ 1. The effect of the variance on the response is still negligible. For 
concreteness, we take / = /o[tanh((s — ^)/As) + 1]. Consider now the fraction of time 
the derivative of the response is near max(/). This requires that r ^ (so that the 
degradation, kr, is negligible), but s is already large, (s — fi)/ As ^ 1. The probability 
of this happening depends on the signal variance and hence on the speed with which 
the signal crosses over the threshold region. Thus one can estimate a by observing 
a molecular circuit for a long time and counting how often the rate of change of the 
response is large. While the probability of a large derivative will depend on the exact 
shape of /, for a signal defined by Eq. (jl]), the statistical error of any such counting 
estimator will scale as oc a/t/T. Hence, the system can be almost insensitive to a on 
short time scales, but allow its determination from long observations. 

To verify this, we simulate the signal determined by Eq. (jl]) with the kr = 20, which 
maximizes the signal-response mutual information. We calculate the mean fraction 
of time when the response derivative is above 80% of its maximum value. We 
further calculate the standard deviation of the fraction a^. We repeat this for signals 
with various As /a and for for experiments of different duration, obtaining a time- 
dependence of the Z-score for disambiguating two signals with different variances Z = 
(02 — 0i)/ \J '^4>i + '^02' where the indeces 1,2 denote the signals being disambiguated. 
For example, for distinguishing signals with As/a = 1/10 and 1/20, we estimate 
Z ^ 0.8(T/r)°-^s^°-°^ consistent with the square root scaling (the error bars indicate 
the 95% confidence interval). That is, for T/r as little as 10, Z > 2, and the two 
signals are distinguishable. Signals with larger variances are harder to disambiguate. 
For example, for As/a = 1/90 and 1/100, Z ^ 9.4 x io-3(T/r)°-56±°-°8, and Z crosses 
2 for T ISOOOr. 

This long-term variance determination can be performed molecularly in many 
different ways. For example, one can use a feedforward incoherent loop with r as an 
input [15]. The loop acts as a approximate differentiator for signals that change slowly 
compared to its internal relaxation times [I6]. The output species of the loop can then 
activate a subsequent species by a Hill-like dynamics, with the activation threshold close 
to the maximum of the possible derivative. If this last species degrades slowly, it will 
integrate the fraction of time when dr/dt is above the threshold, providing the readout 
of the signal variance. 

3. Discussion 

In this article, we have argued that simple molecular circuitry can respond to signals in 
a gain- insensitive way without a need for adaptation and feedback loops. That is, these 
circuits can be sensitive only to the signal value relative to its standard deviation. To 
make the mechanism work, the signaling system must obey the following criteria 

• a nonlinear-linear (NL) response; that is, a strongly nonlinear, sigmoidal synthesis 
function / integrated (linearly) over time; 
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• properly matched time scales of the signal and the response dynamics. 

In addition, the information about the signal variance can be recovered, for example, if 

• large excursions of the response derivative can be counted over long times. 

Naively transmitted information of only one bit (on or off) would be possible with 
a step-function synthesis /. However, the response in this system is a time- average of a 
nonlinear function of the signal. This allows to use temporal correlations in the signal 
to transmit more than 1 bit of information for broad classes of signals. While 1.35 bits 
may not seem like much more than 1, the question of whether biological systems can 
achieve more than 1 bit at all is still a topic of active research [T71 [18] . Similar use of 
temporal correlations has been reported to increase information transmission in other 
circuits, such as clocks [19]. In practice, in our case, there is a tradeoff between variance- 
independence and high information transmission through the circuit: a wider synthesis 
function would produce higher maximal information for properly tuned signals, but the 
information would drop down to zero if As 3> a. It would be interesting to explore the 
optimal operational point for this tradeoff under various optimization hypotheses. 

While our analysis is applicable to any molecular system that satisfies the three 
conditions listed above, there are specific examples where we believe it may be especially 
relevant. The E. coli chemotaxis flagellar motor has a very sharp response curve (Hill 
coefficient of about 10) [12]. This system is possibly the best studied example of 
biological adaptation to the mean of the signal. However, the question of whether 
the system is insensitive to the signal variance changes has not been addressed. The 
ultrasensitivity of the motor suggests that it might be. Similarly, in eukaryotic signaling, 
push-pull enzymatic amplifiers, including MAP kinase mediated signaling pathways, 
are also known for their ultrasensitivity [20l [2T| [22] . And yet ability of these circuits 
to respond to temporally-varying signals in a variance-independent way has not been 
explored. 

We end this article with a simple observation. While the number of biological 
information processing systems is astonishing, the types of computations they perform 
are limited. Focusing on the computation would allow cross-fertilization between 
seemingly disparate fields of quantitative biology. The phenomenon studied here, 
lifted wholesale from neurobiology literature, is an example. Arguably, computational 
neuroscience has had a head start compared to computational molecular systems biology. 
The latter can benefit immensely by embracing well-developed results and concepts from 
the former. 
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